منابع مشابه
A Methodology for Spark Parameter Tuning
Spark has been established as an attractive platform for big data analysis, since it manages to hide most of the complexities related to parallelism, fault tolerance and cluster setting from developers. However, this comes at the expense of having over 150 configurable parameters, the impact of which cannot be exhaustively examined due to the exponential amount of their combinations. The defaul...
متن کاملSpark Parameter Tuning via Trial-and-Error
Spark has been established as an attractive platform for big data analysis, since it manages to hide most of the complexities related to parallelism, fault tolerance and cluster setting from developers. However, this comes at the expense of having over 150 configurable parameters, the impact of which cannot be exhaustively examined due to the exponential amount of their combinations. The defaul...
متن کاملApplication-Driven Parameter Tuning Methodology for Dynamic Neural Field Equations
In this paper, a method is introduced in order to qualify the performance of dynamic neural fields (DNF). The method is applied to Amari’s DNF equations, in order to drive the tuning of its free parameters. An original evaluation procedure is presented, and then applied to some input evolution scenarios. Such scenarios define an applicative context, for which the parameters with the lowest eval...
متن کاملEfficient and Robust Parameter Tuning for Heuristic Algorithms
The main advantage of heuristic or metaheuristic algorithms compared to exact optimization methods is their ability in handling large-scale instances within a reasonable time, albeit at the expense of losing a guarantee for achieving the optimal solution. Therefore, metaheuristic techniques are appropriate choices for solving NP-hard problems to near optimality. Since the parameters of heuristi...
متن کاملTuning Java Garbage Collection for Spark Applications
Spark is gaining wide industry adoption due to its superior performance, simple interfaces, and a rich library for analysis and calculation. Like many projects in the big data ecosystem, Spark runs on the Java Virtual Machine (JVM). Because Spark can store large amounts of data in memory, it has a major reliance on Java’s memory management and garbage collection (GC). New initiatives like Proje...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Big Data Research
سال: 2018
ISSN: 2214-5796
DOI: 10.1016/j.bdr.2017.05.001